This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 

BEST AVAILABLE IMAGES 



Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 
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PLIM-BASED PACKAGE IDENTIFICATION AND 
DIMENSIONING (PID) SYSTEM 



LDIP 

PackageDimensioner 
with Integrated Package 
Velocitv Detection 



A uto- Foe us/A u to-Zoom 
Digital Camera 



I 



Camera Control Computer 
Subsystem 

(Figs. 24A.24B. 25,26. 27. 
28. 29) 



Package 
Velocits 
► 



Real-Time Package Height 
Profiling and Edge- 
Detection Processing 
Module 

(Fias. 21.22. 23) 



LDIP Subsystem 



Fia. 20 



LDIP REAL-TIME PACKAGE HEIGHT PROFILE AND 
EDGE DETECTION METHOD 



A- 



Raw data is received ever> 5ms: plus 
time stamp 



B- 



Convert raw data into range profile 

R=r(int. phase |. referenced with respect 

to Polar CoordinateSv stem 

s\ mbolicaJly embedded in LDIP 

Subsystem. 



!c- 



T 



Use Geometric transformations 

h|i| = Rji|sin(ang - 90) and 

x|i| = R|i|tan(ang - 90) to convert range 

profile RJi| into height h|i| and position 

\|i| data. 



•D- 



Obtain current package height by 
finding prevailing height using edge 
detection w ithout filtering (Fi ii. 22). 



E- 



Find the coordinates of the left and : 
right edges of package < I .PH. RP.F) by 
searching :or ihe closest coordinates 
frmn the edges oi thc bell i 
low ard the center therein" 



« "re lie limc-l.>;-;\- j JliU: ^! : I PH. h 

p i ieu-eJge coordinate • LPh;. current 

package height, package right ed«je 
coordinate «. l.Phh cu>rdiiuile i Rlti. 

package \ c!« . and liir.e 1 nT.v 



LDIP Package Dimensioner with Irtegrated 
Velocity Detection 


Real-Time 




Package Height 




f Profiling and 




Edge Detection 




Processing 




Module 




hell \ clock) 









Send Jala set to camera control 
computer. 



Fis. 21 



REAL-TIME PACKAGE EDGE DETECTION METHOD 






Xj= location -l" belt left edge: Xb=iacaiion of beii right cdac 
la= belt left edge pixel: lb= belt right edge pixel 
I.PK=Leri package edge: KPH= Right package edge 
H| |= Pi\d height array: X| |= Pixel Ideation array 
•\\r)- package detection window 



Fig. 22 
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CAMERA CONTROL PROCESS CARRIED OUT WITHIN THE 
CAMERA CONTROL SUBSYSTEM 

Start 
± 



Camera Control Computer receives a time-stamped quintuple Data Set (i.e. coordinate of Left 
Package Edge coordinate of Right Package Edge, height, velocity, and time-stamp) from the LDIP 
Subsystem and store the Data Set in a Package Data Buffer Structure having N=5 columns and M 



Camera Control Computer analyzes heightdata in the Package Data Buffer and detect the occurrence 
of detecting he.ghtd.scont.nukies. and based on such detected height discontinuities, determines the 

c.vTZT ? miUe T ti0 " ° f tHe ' eading paCkagC CdgeS S ^ ed b - v ldt ™ ™* "ght-most 
coordinate values associated with the data set at this detected height discontinuity 



Camera Control Computer determines the height of the package associated with the 
leading package edges determined at Block B above. 



( "amera ( bntrol Computer 

tranM^rms coordinate p. sjuon 
or leading package edgc< .to 
Giubal ('a)rdinate Reference 
S><!ern symMiolK embedded 
in Hie Ima-jc h>rmation ^d 
Detection < \H)t Sunsv >tem. 



D 



Camera Control 
( omputer unalv zes the 
j height values (i.e. 
j coordinates) stored in 



the i a 



Halter, and dctcrm;;v> 
the height of package. 



Camera Control Computer 
unaK/es height value in [he 
Package Data Buffer, arxi 
determines the speed of 
package <V >. 
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Fig. 24A 
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Camera Control Computer 
detects the corner coordinates 
(i.e. vertices) of the package 
based on the spatially- 
transformed coordinate values 
of the leading package edges in 
the Package Data Buffer. 



Based on detected package corner 
coordinates determined at Block M. the 
Camera Control Computer determines 
the correspond ng pixel indices (i, j) in 
O— I the Image Buffer which specifies the 
image frame(i.e. region of interest) to 
be cropped from the image(s) to be 
subsequently captured by the IFD 
Subsystem. 



Camera Control Computer uses 
Focus/Zoom Lookup Table in Fig. 27 to 
E —| determine the focus and zoom lens 

group positions based on the height of 
the package determined at Block D. 



Camera Control Computer transmits 
F — i Lens Group Moves Command to the 

IHVSuhN\Mcin-. 



( umcra ( 'ontrol ( "ompuicr checks 
G — I resulting positions of moved lens 

*j rou ps. 
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Camera ( ontrol Computer corrccN lens 
group positions. 
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The Camera Control Computer uses the 
computed values of average package height, 
speed and the Photo-Integration Time Lookup 
Table in Fig. 29 to determine the photo- 
integration time parameter which will ensure that 
"square" image pixels are produced in captured 
package images (i.e. pixels having a 1:1 aspect 
ration. 



The Camera Control Computer sends digital 
photo-integration time control signal to the CCD 
image detection array in the IFD Subsystem. 



Camera Control Computer uses package time- 
stamp mT) and package velocity (V^) to 
determine the 'Start Time" of Image Frame 
Capture (STIC). 



- P 



Camera Control Computer uses the Start Time of 
Image Capture (STIC) determined at Block (X to 
generate a command for starting Image Frame 
Capture, and the pixel indices (i.jj determined at 
Block N to generate commands for cropping the 
"region of interest" within the captured frame 
stored in the Image Buffer within the IFD 
SubsNstem. 
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Fia. 24B 
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Left Package Right Package Package Time-stamp 

Edge (LDE) Package Height (h) Edge(RPE) Velocity (nT) 

I Row I 

Row 2 

" Row J 

Row 4 

Row 5 

1 1111 Row M 

Package Data Buffer (FIFO) 

Fig. 25 
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Rows 



Camera Pixel Data Buffer 

pixel indices (i f j,) 
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Dimensioned ield of View 



Right P^D U/vTf 




Bottom 



Remote Diagnostics 



Control 
Ethernet 
Hub 



Dimensiooer 

Camera 



Camera ^ 



Camera ^ 



Camera 



(4 



Top (Master) 
MetroCam 



Left 
MetroCam 



4 



Right 
MetroCam 



5. 



Bottom 
MetroCam 



Parcel Start/Stop 

Left Edge, Right Edge/Height every 10 ms 

^ Camera Data, 
80 MBvtes sec 



Camera Data, 
80 MBytes sec 



Camera Data. 
80 MBytes/sec 



Camera Data, 
80 MBytes sec 



Encoder 



r 



Parcel ID 

Remote Diagnostics 



Dimensiooer 
Camera ^ 



Camera 



Camera 



Camera ^ 



r 



Top (Master) 
MetroCam 



Left 
MetroCam 



Right 
MetroCam 



Bottom 
MetroCam 



Encoder 



Control 
"^t Ethernet 
Hub 



Parcel ID, Parcel Start/Stop 

Left Edge, Right Edge, Height every 10 ms 




Barcode Data, 

4x1 kBytes 
Binarized Image Data, 

4 x 100 kBytes 



/% 3 2 



